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PREFACE 


This  technical  report  summarizes  a  study  effort  performed  at  Air  Force 
Flight  Dynamics  Laboratory,  Vright-Patterson  Air  Force  Base,  Ohio,  under  a 
Mini-Grant  AFOSR— 78-3615  from  the  Air  Force  Office  of  Scientific  Research. 

Dr.  Joseph  Bram,  Directorate  of  Mathematical  and  Information  Sciences 
was  the  Air  Force  Program  Manager. 

The  Research  Foundation  of  the  State  University  of  New  York  through  the 
1  "cal  Office  of  Cranfa  at  t_he  State  university  ooxaege,  uiteuia 

monitored  the  administrative  details  of  the  grant. 


SUMMARY 


SCudv  Objectives 

The  objectives  to  be  pursued  under  this  grant  were  to  conduct  analytical 
and  application  oriented  (especially  to  aircraft  industry)  study  of  D-optimal 
design.  The  analytical  study  was  aimed,  partly,  at  answering  questions  such 
as : 

"How  does  D-optimal  design  fare  with  respect  to  such  properties  as  the 
uniqueness  and  orthogonality  of  the  design,  confounding  of  effects,  interac¬ 
tions  between  the  variables  for  linear  and  quadratic  responses?" 

The  purpose  of  the  application  oriented  effort  was  to  demonstrate  the 
application  of  the  analytical  results  obtained  to  a  typical  Ground  Attack 
Mission  Profile  and,  independently,  to  a  three-dimensional  design  space  to 
select  input  conditions  for  an  aircraft  sizing  program. 

The  computer-aided  D-optimal  Design  Program  was  supplied  to  the  Design 
group  at  Flight  Dynamics  Laboratory,  Wright -Patterson  Air  Force  Base,  with 
the  request  to  run  the  program  and  obtain  the  simulated  values  of  the  various 
responses  so  that  further  statistical  analysis  and  a  sensitivity  analysis  on 
the  performance  functions  in  a  region  of  aircraft  designs  encompassing  the 
optimum  combinations  of  engine/airframe  variables  could  be  carried  out  and  the 
validity  of  the  theoretical  results  could  be  verified  and  confirmed. 

This  application  oriented  objective  of  the  study  including  statistical 
and  sensitivity  analysis  could  not  be  fulfilled  because  of  the  frustrating 
noncooperation  of  the  Design  group  in  supplying  the  requested  data.  The 
requested  simulated  values  have  not  been  received  even  as  of  to-day  (perhaps 
they  will  never  be  supplied  by  the  Design  group!). 


INTRODUCTION 


When  engine  cycles  and  airframe  concepts  are  analytically  integrated 
to  define  an  airplane  system,  the  engine  and  airframe  subsystems  or  ele¬ 
ments  interact  with  one  another.  Engine  physical  characteristics  affect 
the  sice,  shape,  weight  and  balance  of  the  airframe.  Airframe  charac¬ 
teristics  affect  the  installed  performance  of  the  propulsion  system.  If 
engines  and  airframe  are  to  be  properly  integrated,  element  interactions, 
as  well  as  isolated  characteristics  must  be  taken  into  account. 

Engine/airframe  interactions  must  be  exploited  in  preliminary  system 
design  studies.  Proper  exploitation  of  subsystem  interactions  car  only 
be  accomplished  by  freeing  design  variables  and  allowing  them  to  adjust 
to  levels  which  satisfy  requirements  on  the  system  and  compatibility  de¬ 
mands  on  one  another. 

Advanced  engine  cycle  concepts  add  a  new  dimension  of  complexity  to 
analytical  engine/airframe  integration.  It  is  inconceivable  that  inte¬ 
gration  could  be  properly  accomplished  traditionally,  when  performance 
characteristics  of  a  new,  advanced  engine  cycle  are  not  known  completely. 
Furthermore,  mission  requirements  are  generally  complex,  very  demanding, 
and  unfamiliar.  The  systems  which  must  satisfy  these  requirements  are 
equally  complex.  To  be  as  effective  as  possible,  every  advantage  must 
be  taken  in  the  design  of  an  optimum  system.  Free,  interactive  subsystem 
integration  becomes  a  requirement. 

Free  design  means  all  important  design  parameters  are  free  to  attain 
an  optimum,  system  compatable  value.  For  known  airframe  concepts  this 
means  at  least  four  or  five  parameters  must  be  examined.  Current  engine 
cycles  have  three  or  four  and  advanced  cycles  could  add  an  additional 
two  or  three.  So  the  analytical  system  integration  problem  concerns 
itself  with  from  nine  to  twelve  design  parameters. 
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Evaluation  of  installed  and  integrated  performance  of  advanced  engine 
concepts  requires  estimation  of  the  effects  of  these  independent  design 
parameters.  This  is  accomplished  through  parametric  perturbation  of  engine 
and  airframe  design  variables  such  as  cycle  pressure  ratio,  turbine  tem¬ 
perature,  bypass  ratio,  engine  size,  wing  loading,  aspect  ratio,  thick- 
ness-to-chord  ratio,  etc.  Their  effects  are  expressed  as  values  of  a  set 
of  airplane  performance  indicators  or  response  functions,  such  as  range, 
take-off  gross  weight,  fuel  consumption,  etc.  If  the  effects  of  the 
design  variables  are  to  be  estimated  by  manually  interpolating  from  the 
function  values  at  representative  data  points  in  a  multi-dimensional 
problem,  gross  simplifications  have  to  be  made  in  the  analysis  in  order 
to  avoid  large  expenditures  in  engineering  and  computer  time. 

This  usually  results  in  only  partial  evaluation  of  the  relevant  ef¬ 
fects  of  design  variables  on  installed  engine  performance  in  an  airplane. 
Even  at  that,  the  engineering  time  in  both  manhours  and  flowtime,  as  well 
as  the  computer  resources  required  to  develop  the  necessary  data  points, 
are  prohibitive. 

Therefore,  in  order  that  all  the  relevant  design  parameters  in  an 
engine/airframe  concept  can  be  analyzed,  a  very  wide  scope  of  engine  and 
airframe  configurations  can  be  evaluated,  and  that  engineering  and 
computer  resources  can  be  cut  by  as  much  as  20%,  the  aircraft  designers 
have  developed  a  comprehensive  airframe/engine  screening  methodology. 

The  mathematical  elements  in  the  methodology  are  directed  to  the  efficient 
identification  of  optimal  combinations  of  engine  and  airframe  variables 
(design).  Optimality  is  defined  as  the  process  of  minimizing  (or  maxi¬ 
mizing)  one  system  performance  function,  like  takeoff  gross  weight,  while 
constraining  other  functions,  like  takeoff  distance,  to  be  below  (or  above) 
a  specified  value.  The  methodology  is  based  on  advanced  statistical  and 
mathematical  optimization  procedures  which  allow  maximum  information  to  be 
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derived  from  a  minimum  amount  of  data.  The  procedures  include  statistical 
experimental  design,  regression  surface  fitting  of  engine/airframe  design 
response  function,  surface  cit  evaluation,  optimization  and  sensitivitv 
analysis . 

The  screening  process  is  formulated  as  an  optimum  design  problem,  in 
which  a  cost  function  (such  as  takeoff  gross  weight)  is  minimized  subject 
to  constraints  on  other  response  functions.  The  choice  of  algorithms  for 
minimization  with  constraints  may  depend  on  many  factors  including  whether 
or  not  derivatives,  ,  of  the  performance  functions  with  respect  to 


design  variables,  X:  ,  are  available.  Gradient-directed  search  techniques 

Jr 

are  generally  mere  efficient  than  minimization  techniques  which  use 
function  values  only,  with  no  derivatives  (Reference  1).  However,  gra¬ 
dients  may  be  unavailable  except  at  great  expense  in  terms  of  computer 
run  time  or  the  time  in  manhours  required  to  supply  partial  derivative 
calculations  in  algorithmic  form  for  the  computer,  since  the  ultimate 
functional  expressions  of  the  performance  functions  which  generate  the 
function  values  at  each  design  point  are  not  known  in  analytical  form. 

In  order  that  one  can  save  on  computer  run  time  and  still  be  able  to 
use  an  efficient  gradient-directed  search  method,  the  complicated  unknown 
performance  measure  functions  are  approximated  by  simple  functions,  for 
which  the  derivatives  are  easy  to  express  analytically  for  the  computer. 
These  approximating  functions  are  referred  to  as  surface  fits,  since 
they  approximate  the  n-dimensional  surface  defined  in  (n+1)  dimensional 
space  by  a  function  of  n  variables.  These  approximating  functions  are 
readily  expressed  analytically ,  since  they  are  chosen  to  have  some  ele¬ 
mentary  form,  such  as  a  polynomial. 

Surface  fit  approximating  functions  make  partial  derivatives  available 


in  analytical  form. 


This  makes  possible  the  direct  use  of  a  gradient- 
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based  minimization  method  and  results  in  economical  optimization  runs  on 
the  computer.  This  in  turn  alleviates  the  problem  of  approximation  er¬ 
ror  in  a  region  near  the  optimum,  for  this  region  can  be  explored  by 
re-optimizing  with  the  cost  function  constrained  to  stay  within  a 
specified  cost-increase  tolerance. 

The  coefficients  tor  the  polynomial  approximating  functions  are  ob¬ 
tained  by  using  least  squares  regression.  A  surface  fit  approximation 
is  formed  for  the  hypersurface  representing  each  response  function  in 
the  multi-dimensional  space  of  the  n-design  variables .  Data  values  for 
the  performance  functions  which  are  to  be  used  in  an  engine/airframe 
screening  evaluation  are  obtained  at  preselected  combinations  of  design 
parameter  values. 

Additional  data  are  used  to  further  evaluate  the  validity  of  the 
approximations  so  obtained.  Finally,  the  surface  fit  functional  equa¬ 
tions  are  used  by  the  optimization/sensitivity  analysis  program  to  find  a 
region  in  design  space  which  has  maximal  productivity  of  good  airplane 
designs . 

Hence  the  screening  methodology  consists  of  four  main  steps.  These 
in  nrAnr-  0f  occuT^ce  in  the  screening  procedure: 

1.  The  data  selector  step 

2.  The  surface  fit  procedure 

3.  Evaluation  of  the  surface  Fit 

4.  The  optimization  and  sensitivity  analysis. 

These  four  steps  precede  the  final  evaluation  of  designs  in  the 
selected  optimal  region  by  the  engine  cycle  matching  and  performance 
matching  programs.  The  final  evaluation  provides  direct  simulation 
results  at  the  design  parameter  combinations  which  have  been  selected  in 
optimization/sensitivity  analysis.  Obviously,  the  validity  of  the  re¬ 
sults  of  the  optimization  and  sensitivity  analysis  depends  heavily  on  the 
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accuracy  of  Che  surface  fit  approximation  procedure.  For  this  reason, 
the  data  which  is  to  be  used  in  the  surface  fit  procedure  must  be 
selected  with  care. 

EXPERIMENTAL  DESIGN 

The  search  for  an  effective  means  of  selecting  the  combinations  of 
values  for  the  engine/airframe  design  variables  which  are  to  be  used  for 
surface  fit  data  involves  the  field  of  experimental  design.  Design  var¬ 
iables  are  quantities  such  as  BPR  or  W/S  which  may  be  varied  indepen¬ 
dently  as  input  to  the  engine  cycle  matching  and  performance  simulation 
programs  to  obtain  as  output  the  values  of  certain  response  functions 
(e.g.,  TO GW) .  These  functions  are  a  measure  of  the  performance  of  a 
hypothetical  airplane  design  which  is  specified  by  a  particular  combina¬ 
tion  of  values  of  the  design  variables. 

Experimental  design,  on  the  other  hand,  refers  to  the  design  of  an 
experiment  to  gather  and  evaluate  data.  Here,  the  data  are  the  values 
of  the  performance  functions  corresponding  to  each  of  the  aircraft  designs 
which  are  specified  by  the  design  selector.  The  surface  fit  of  approxi¬ 
mating  functions  to  these  data  involves  the  evaluation  phase  of  the 
experiment.  The  approximating  functions  are  to  be  used  to  predict  the 
performance  of  airplane  designs  for  which  no  data  has  been  obtained. 

These  predicted  performance  function  values,  which  are  used  by  the 
optimisation  program,  will  bp  only  as  valid  as  the  surface  fit  results. 

The  experimental  design  specifies  the  airplane  design  combinations  to  be 
used  in  getting  data  values  for  the  performance  functions.  It  also 
specifies  the  analytical  form  which  the  surface  fit  approximating  func¬ 
tions  are  to  have.  Hence,  the  validity  of  the  surface  fit  results 
depends  on  choosing  a  good  experimental  design.  But,  what  is  a  "good" 
experimental  design? 
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In  order  to  answer  this  question  satisfactorily  we  need  now  to  in¬ 
troduce  the  concept  of  a  regression  model  which  will,  in  turn  be  used 
to  explain  the  concepts  leading  to  the  desirable  properties  of  a  "good' 
experimr  .1  design. 


7. 


MODEL  AND  NOTATION 


le  set  ot 


points  P  =  (  Xv  ..  )  at  which  runs  can  he  made 


is  cal'  ' d  the  n-diraens ional  factor  space.  We  assume  that  at  a  given 
point  of  the  factor  space  only  one  quantity  can  be  measured.  Let 
be  the  results  of  observations  at  the  points  P,  ,  P,, ,  ...,  P  of  the 
factor  soace.  In  other  words,  V  is  the  value  of  the  response  variable 

'J 

in  the  trial.  We  consider  the  model 


j-  -  l,  V"  .  M 


which  we  express  in  matrix  notation  as 


'i  =  X  (1  -t-£ 


'Y.  \<tl ' >"■ Y  }  is  an  N  x  1  vector  of  observations. 

N 

21  an  x  x  K  matrix’  K'- 


r-vO  f n  -vi'i 


is  a  Kx\  vector  of  unknown  parameters, 

/ 

(6)  ^  is  an  N  x  1  vector  of  independently  and 

identically  distributed  random  variables  C;  with  mean  £,  (  £ ;  )  =  Q 

(f  *  J 

1 

and  variance  V  (.  —  G”  . 

/  / 

;  denotes  the  value  of  the  n  x  1  vector  X  = 

of  predictor  variables  X>  at  the  point  P:  of  the  factor  space. 

*■  tf 

^  ^  is  a  vector  which  depends  on  the  form  of  the  response 

function  assumed. 

Based  on  their  past  experience  with  the  performance  function  data, 
aerospace  corporations  have  been  using  quadratic  forms  for  the  approxi¬ 
mating  functions.  Quadratic  forms  are  used  as  the  baseline  surface-fit 
function.  In  case  these  fail  to  provide  good  approximations  to  the 


performance  function  data  values,  othtr  functional  forms  can  be  tried. 


dhese  inigl-u  include  combinations  or  higher  order  polynomials  and 
exponential  functions.  In  tne  following  discussions  tb-  type  of 
approximating  functions  will  be  assumed  to  be  a  quadratic  polynomial 
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/ 

that  the  transpose ■((•i^o f  the  bx '  vector  given  by 

(7)  f(5j)  =  (><  xil  iXi». ‘i.'ix . 


X-  is  the  value  of  the  independent  variable  T'b  in  the  £K'r'  trial. 

/ 

Substituting  for  ClOf rom  (7)  in  (4)  the  matrix  X.  be. ones 


1 


(8)  X=!  '  X 

L' 


a\ 

i 

n\ 


.... 

VSz" 

X 

u 

2. 

*:b‘ 

-  X 

i\ 

Z 

XNI 

NY\ 

*  H» 

x  x  ! 

\n-  \y\  | 


Substituting  for  _X  from  (8j  ,  for  ft  mom  (5),  for  t  from  (6), 
and  for  X  from  (3)  in  Eq.  (2),  we  obtain 


1 


(9) 


\  = 


L 


4*-  \ 

r\ 


.  z.\ 
T\ 


Z  n 

,L  *  Z  -V 

n-\ 

I 

n 

i 

i\yy 

<; 

Vv 

L-l 

Z  n 

X ;  ■  *  y  3,  -  X  •  ; 

5  z  *.1  4 

n- 

*  I 

u 

I. 

.A*** 

\y<i- 


+  i  *«<  +  l  £  ^  + 

a.  *  h»\  '"-Z 


th 


Inis  matrix  equation  yields  a  system  cf  X  equations 


(10) 


h  >  *  +£  (v.w.  +  I  I  ISu  VVfci  ’ 

o.  yo  '  1  xc  u  .  a  W- '  c- Z. 

i  -\  *  - 1  , 


V\  <-  ■c 


# 

which  is  the  same  as  Eq.  (1)  after  substituting  for  -$(?j)from  (7). 

/ 

Denoting  by  X  the  transpose  of  the  matrix  X  *  the  K^YLsyranietric 


ma 


;ri^/C  X^-s  called  the  information  matrix.  Using  (8)  we  get 
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u  Z 

N  7  x. 

il 

v-»  d 

Vx1 

4-  '  A 

T  x. 

L  i' 

**;»  ... 

V  X  ■  K 

4-  J"-'  2* 

lxi>  Ixi> 

z  4  i  ■ 

<-2  2. 
-z’-.v  v 

■  £  *j>  V-' 

/  J 


2 

V 

7  x1 

4-  ^ 

i  -  i 

44  ^u-iVVV 

,  ;  1 

X 

V 

z44" 

I x>  iVi.  I>;.V1VV 

X' 

ZXllKi!  - 

2  Vy.  x-  •  ••  7  X .  X  •  *  • 

I  £.*j\  4  4.  j\  ^  ^ 

XI 

*4  - 

2  2.  Tn-.x  'x- 

x  xn  >  IV*  Zqj-  1  •:>  v-wn 

%  ixin4-tv  iw1'* 


I>>4  lX>«4 


:ji  Kjn  X  *i"  I  *j.  *jl 


Zxj,V  1 4  *»i  *  VV*V;»V’ 

r «•,,  v  x  4  >  1  xi'  4  vz  xi-  v 1 4  > 1  vv^svw 

Sxiixsixii  l4*ii  •••2.xi»’l>'’'>»  Z’WivZ’^'ii  Z  “’" 

;  2. 

ZV-’i*  Z*j,.SU't>  Z’i~,i.Vf’i-VEV,i«’i.ZVlV.  •:- 


Let  us  dentoe  theK*L  vector  of  estimated  regression  coefficients  b0.  bu  (  t 

^  \  ’  •••  ‘  ^  i  *  •■*  •  b,*  ,  ....  ,  V, 

as  Vj  :  * 

/ 

/io\  L.  —  (  Vj  - .  b  \s  ■  ■  .  \o  b  . ,  U  •••  b 

(Id;  3.  —  \  o  °u  rvn  '  n  11  °',n  2  "b  n-\  m  J 

Then  assuming  that  the  information  matrix  is  non-singular,  the  least 

squares  estimates  of  the  unknown  parameters  'b  in  the  regression 

model  (2)  are  given  by 

(13)  ^  -  (x  X.)  X  x 

The  variance-covariance  matrix  of  b  is 

(14)  \[{^)  =  G"2-  Q  X^X)  ' 

At  any  point  x_  of  the  experimental  region")^  ,  the  predicted  response  is 

(15)  *  ...  . 


v(  (xV7 


h  U)  =  i(*)k 


10. 


with  variance 
(16) 


VLIC  *)]  =  cr2  f '(^(X'X  )'Vs) 


4.  REP  ARAME  TE  RI Z  AT  1 0  >J 

Least  squares  results  tend  to  be  sensitive  to  rounding  of  data  in  in¬ 
termediate  stages  of  calculations.  When  the  number  of  independent  vari¬ 
ables  is  small  -  say  three  or  less  -  roundoff  effects  can  be  controlled 
by  carrying  a  sufficient  number  of  digits  in  intermediate  calculations. 
But  this  expedient  becomes  increasingly  inefficient  as  the  number  of  in¬ 
dependent  variables  becomes  larger.  Roundoff  errors  tend  to  enter  into 

/ 

least  squares  calculations  primarily  when  the  inverse  of  X  X  is  taken. 

Of  course,  any  errors  in  (*'*j  may  be  magnified  when  calculating 

(see  Eq.  13)  or  making  other  subsequent  calculations  (see  Eqs.  14,  16). 

The  danger  of  serious  roundoff  errors  in|X  is  particularly  great 

/ 

when  the  elements  of  XXdiffer  substantially  in  order  of  magnitude.  A 
solution  for  this  condition  is  to  transform  the  variables  and  thereby 
reparameterize  the  regression  model.  If  denotes  a  natural  independent 
variable  and  the  corresponding  transformed  variable,  then  the  trans¬ 
formation  c  V.  (  *  .  j-  V  .  .  N 

3;  "  x  (  ’a.  ,  _ hx.  ,  TTUY\  / 

*-  •£  (,  ~  ^  k  ,  'rr\\y\') 

where  N  •  ,  max  =.  maximum  value  of  S-  ,  , 

rain  =  minimum  value  of  , 

makes  the  transformed  variables  to  fall  between  -1  and  +1,  so  that  the 
calculation  of  the  inverse  matrix  becomes  much  less  subject  to  roundoff 
errors  due  to  dissimilar  orders  of  magnitudes  than  with  the  original 
variables.  The  transformed  variables  X^are  called  the  normalized  form  of 
the  natural  variables  •  Henceforth,  we  assume  that  the  in¬ 

dependent  variables  appearing  in  this  work  are  all  normalized  so  that 

-1£*:<1  . 


Farther,  the  regression  coefficients,  even  in  the  reparameterized 


model,  are  affected  by  the  spacing  of  the  independent  variables,  which 
may  be  quite  arbitrary.  It  is  desirable,  therefore,  to  scale  the  factors 
uniformly,  and  we  shall  do  this  by  imposing  the  following  restrictions 
upon  the  values  of  the  independent  variables: 
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XX  - 

(20) 
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a-  kn 


Q*  in 


q 

o 


o 

o 


C  kn  +  ^  X  n 

0  ft-  kn 

0  O 


O 

o 

o 

Cl 
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—  .  r 

where  1^=  (1  1...1)  is  an  n  x  1  vector, Jn is  a  square  matrix  of  order 

n  with  every  element  1,  and  L  is  a  unit  matrix  of  order  n. 


The  inverse 


,  when  it  exists,  is  a  similarly  patterned  matrix 


x'x) 

(21) 


-l 


Uy, 


<V!n 


o 

o 


*  kn  +  t  = 


o 

o 


~  n 


0 

0 


T 

o~  in 

o 


-  (V< 


Taking  the  product  X )  (X  =  IK  gives  a  set  of  five  consistent 

equations  in  the  four  unknowns  ^  />  and  £  . 


(22) 

N  'p 

+■ 

r> 

a 

(23) 

+ 

CL 

(n/s  -v-  *0  = 

O 

(24) 

CL  \p 

+ 

<V 

C 

Y)  C  +•  d  )  ■ 

=  O 

(25) 

a  <V 

4- 

dL 

/> 

■V  cdt  -v 

nc.  4 

(26) 

d  i 

s. 

\ 

The  last  equation  gives  t  =  1/d  •  Eliminating  t  from  Eqs. 
(24)  gives  _  (d  —  HC  j 


(22)  and 


and  solving  Eqs.  (21)  and  (23)  gives 

s«-^--C'nC  +  d)^ 

and  ^  _  o.y'’  (nC  t  T'<5'  ^ 

If  we  now  write  [  d  \  M  (  ~  ^  \  Y  '  =A 

these  solutions  become  ^ 

*p  -  1  d.)  A  ,  V-'^A,  ^  ' 

Using  the  form  (21)  of  the  inverse  matrix  (VX  X  \  'of  the  information 
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matrix,  the  variance-covariance  matrix  (14)  becomes 


V(b)  = 


(27) 


\>  <r  2 

5"1  k  C 

0 

*■ 

0 

^  1  n 

^  • U  + 

0 

Q 

o ' 

0 

1  T 

9 

o 

0 

£a)j 

It  would  be  convenient  if  we  could  choose  the  design  points  in  such  a  way 
that  cov  (b_,h.)  =  0  for  all  h,  and  cov  (b  .b..)  =  0  for  all  h,  i,  h  ^  i. 

W  hh  Kh  4* 

The  first  condition  cannot  be  satisfied,  for  we  have 

cov  (b  ,b  )  =  =  -  adA  j-  ^ 

o 

and  a)0,  d>0,  A#0.  Hence,  q#0  and  the  covariance  cannot  be  made 
to  vanish.  On  the  other  hand, 

ccv  (b^jb-)  =  S(T=  (a2  -  Nc)  At1 

and  a  necessary  and  sufficient  condition  for  this  to  vanish  is  that 
a2  -  Nc  =  0 

It  is  customary  to  call  the  property 

(28)  cov  (bhK,b.A)  =  0 

the  orthogonality  property  for  quadratic  response  surface  designs,  and 

(29)  a2  =  Nc 

the  orthogonality  condition  for  quadratic  response  surface  designs. 


5.  DESIRABLE  PROPERTIES  OF  A  GOOD  EXPERIMENTAL  DESIGN 


Now  we  are  in  a  position  to  answer  the  question  raised  in  Section  2 
as  to  what  characterizes  a  "good"  experimental  design.  These  character¬ 
istics  are  described  below. 

(a)  Non-singular  information  matrix.  The  experimental  design  should 

allow  choice  of  such  points  in  the  factor  spaceX  that  under  the  in¬ 
formation  matrix  non-singular  allowing  the  normal  aquations  to  yield 
least  squares  estimates  _b  of  the  unknown  parameters  (see  Eq.  13). 
The  number  of  such  points  in  X,  should  be  kept  to  a  minimum  in  order 
to  make  the  process  more  cost  effective.  For  a  n-dimensional  design 


(29) 
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fr\+  d\ 

of  order  d,  this  minimum  number  is  I  J  .  A  design  matrix  A.  (see 

Eq.  S)  of  a  n-dimensional  design  of  order  d  is  said  to  be  saturated 
/n+d.'i 

if  it  has  exactly  V  ^  j linearly  independent  rows. 

(b )  No  confounding  of  the  effects  of  different  terms  in  the  surface- 
fit  equation.  Confounding  is  the  degree  to  which  the  effects  of  the 
terms  in  the  surface-fit  equation  are  (pairwise)  confused  with  one 
another  in  the  measurements  of  the  values  obtained  from  the  data. 
Suppose,  for  example,  that  two  independent  design  variables  * ■  and 
X-  (i*j)are  very  highly  correlated  in  the  data.  This  will  cause  the 

a 

value  of  the  linear  correlation  coefficient  to  be  close  to  +1  or 

-1.  This  implies  that  the  measured  values  ^  are,  as  far  as  and 

k 

X;  are  concerned,  almost  a  function  of  a  single  variable.  It  will  be 
i 

hard  to  separate  the  variation  in  due  to  x.frcm  _he  variation  due 

k  * 

to  X;  using  the  data  from  the  design  points  specified  in  the  experi- 
6 

mental  design.  Instead,  design  points  *  ^  should  be  selected  in  such 

a  way  that  =0  ideally  (though  it  is  enough  that  lie  within  a 

confidence  band  of  values  near  0).  This  renders  the  design  variables 

X,  ,  ..,  Xn  statistically  as  well  as  functionally  independent. 

When  the  surface-fit  equation  is  linear  in  the  design  variables 

5  •••»  and  if  these  design  variables  are  functionally  in- 

/ 

dependent,  then  the  matrix  X.  X  is  non-singular  and  the  model  coeffi- 

/ 

cients  have  the  smallest  variance  when  X  X  is  diagonal.  Indeed, 


consider  the  regression  model  for  a  linear  response  surface 

1 :  =  +  Z_  +  H  •  3 -  • 

Q  A  —  ' 

which  we  express  in  matrix  notation  as 

'Y  =  x  (i  -v  L 


K 


(30) 
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The  information  matrix  t^\-  /*x.  is 

H 

N  Pi,  1  xi2 

0'  I'-'  U 

I'*  t'l 

^  *A2  ^  XAlXH  2  Xi2 


L  I  I  1XjnX;vi  "  **  p  j 

Then  it  can  be  shown  (see  pp.  109-110  of  reference  [1])  that 

....  \  <r2  (  .  .  \ 


H 

y  x . 

3®'  ° 

7  x.  x. 

Y  X  •  X; 

^  ii 


v<to  = 


where  Q  is  a  positive  definite  form  in  the  nondiagonal  elements  of  M. 


^  - 


Since  IM\  >°  >  -“l 


— — -  —  O  iff  nondiagonal  elements  of  M  are  zero:  that  is, 

\IA\ 

M  is  a  diagonal  matrix. 

"  Y1 

(34)  diagonal  =>  Var(^=  —  =  min  Var  (lo^N) 

Adopting  the  following  coding  for  the  design  variables 

(35) 

*  Si  .  r 

where  denotes  the  actual  value  of  the  ^^level  of  the  invariable , 

j 

is  the  average  of  the  levels  of  the  Invariable ,  and 
2  S  M  (  %  . .  -  ^ 


we  get 


2  7  7*  f  *  .■  -  V-  ^ 

S.  -  — — - 


M  1 

Z  ■  =  H 


and 
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(38)  M  = 


N 

o 

0 

■  ••  o 

O 

N 

0 

-  -  ■  o 

N 

0 

0 

...  N, 

Tn  this  case  (  i.e.,  when  M  is  given  by  (37)) the  variance  covariance 
matrix  of  b 


=: 

CT1  M  ' 

form 

GOV  (oS(01) 

t-OV  (>0  j 

[ 

j 

r  a-2 

0 

O 

O 

Oo) 

V  (b.) 

Cov  C  b,  ,  bn) 

“ 

N 

o 

o  ...  o 

O'*  >'Do'l 

Ca'1 

1 

v  C 

- 

I 

i 

0 

N 

o  o..  i 

CovJ  c  ,  V)  =  o  ,  v>  *  i. 


1.  X.  and  X . are  uncorrelated, 

h  *■ 

2.  No  confounding  effects,  and 

3.  No  interactions  between  the  design  variables. 

When  the  response  surface  is  approximated  by  a  polynomial  of  degree 

9  2. 

higher  than  the  first,  the  quantities  ...,  Xfl;  x  f  ,  ..., 

;  ...  are  not  all  functionally  independent  and  a  diagonal  moment 

matrix  is  impossible  of  attainment.  Hence  even  there  is  no  assurance  that 
/ 

the  matrix  X^is  non-singular. 

(c)  Orthogonal  design.  Experimental  designs  for  which  the  information 
/ 

matrix  X  Y\  can  be  diagonalized  (see  Eq.  (38))  for  linear  response 


surface),  and  thus,  the  coefficients  in  the  surface  fit  equation  are 
uncorrelated  with  one  another  (see  Eq.  (41))  for  the  linear  response). 


are  called  orthogonal  designs.  For  the  quadratic  response 
represented  by  the  model  in  Eq.  10,  orthogonality  of  the  design 
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ic.^ies  =  o  (see  Eq.  28).  The  prediction  uncertainty, 

which  is  measured  by  the  variance,  for  function  values  and  derivatives 
using  surface  fit  equations  can  be  kept  relatively  low  by  the  use  of 
orthogonal  designs.  Indeed,  there  is  a  certain  amount  of  uncertaintv 
In  the  estimation  of  the  vector  of  model  coefficients  (see  Eqs.  5 
and  31).  This  uncertainty  is  determined  by  the  choice  of  experimental 
design,  as  seen  from  the  variance-covariance  matrix  (14)  and  the 
Eqs.  (33)  and  (40).  The  uncertainty  in  the  estimation  of  model  co¬ 
efficients  causes  an  uncertainty  in  the  prediction  of  function  values 
at  any  point  x  in  design  space^X.  •  Indeed,  let  x  be  a  specified 
1  x  n  vector  whose  elements  are  of  the  same  form  as  a  row  of  the 

A 

matrixy\  (see  Eq.  8).  Then  ^  is  the  value  predicted  at  x_bv  the 
regression  equation  and  has  variance 

v($j=  s'vtWi, 

This  uncertainty  can  strongly  affect  the  sensitivity  analysis  at 
an  optimum  x*  located  by  the  optimization  method  applied  to  the 
surface  fit  functions. 


If  the  design  is  orthogonal,  the  prediction  uncertainty  for 
function  values  of  responses  described  by  a  linear  response  surface 
can  be  reduced  to  a  minimum  because  the  variances  of  estimated  model 
coefficients,  var('oy')  ,  take  minimum  values  in  this  case  (see  Eq.  34). 
This  results  in  a  better  curve-fit  of  the  approximated  response  to 
the  actual  response  surface. 

In  practice,  trial  values  for  the  design  point  combinations 


/  y  .  v  ‘ 


can  always  be  evaluated  for  the  above  properties 


prior  to  actually  using  these  points  as  input  to  an  engine/airframe 
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simulator  program.  Design  points  can  be  added  and  discarded  until 

the  desired  number  M  of  points  satisfying  these  properties  is 

achieved.  However,  this  is  potentially  a  time  consuming  procedure 

unless  a  computer  algorithm  can  be  formulated  for  the  process  of 

adding  and  deleting  large  number  of  data  points  while  testing  the 

/ 

correlation  coefficient  ,  the  matrix  XX  ,  etc.,  which,  on  the 
other  hand,  may  increase  the  cost  factor.  Therefore,  a  reliable 
a  priori  choice  of  experimental  design  is  needed  instead  which  may 
possess  the  above  desired  properties,  can  minimize  the  cost  of  the 
approximations  with  actual  increase  in  accuracy,  and  yields  a 
flyable  aircraft.  Recent  investigations  on  experimental  designs 
show  that  a  considerable  enhancement  of  the  screening  methodology 
based  on  the  number  of  design  points  needed  and  the  efficiencies  of 
the  designs  involved  can  be  realized.  As  such,  4*  ~  Optimal  designs, 
0±\>tG3i  as  proposed  by  Kiefer,  become  potential  candidates  for  such 
a  choice.  In  this  report  we  will  limit  our  considerations  to  c±>^— 
-Optimal  designs,  known  as  D-Optimal  designs,  only. 


6.  D-OPTIMAL  DESIGNS 

Consider  the  N  x  N  information  matrix 


X.  ~  , 

where  N  is  the  number  of  unknown  parameters,  is  the  design,  that  is, 
in  general,  a  probability  measure  over  experimental  region  X.  ,  and  is 
the  unknown  regression  function  (  5^00  5^*)).  Assuming  the  information 

matrix  to  be  non-singular,  let  X  ■  -  A  (.^denote  the  eigenvalues  of 

M  .  Define  the  functional  <4^)^ 

^  (  V)  =  i*.  K '('£,)]  =  \n’  X.  \  (*>)] 

<£>(V)^  </>  cM  =  K'(^m 

0  '  Ip  — ^  o+  >  1  ^ 

<P  <\)  =  Urn  4>  CVj  = 

1 15  I  <  L  M 


o  <  t* 


<  CO 


Vm 


oo 
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A<&  ~  optimal  design  ^  is  one  that  minimizes  4  (V/*  Thus,  a  4  _ 


optimal  design  minimizes  U«t  which  is  equivalent  to  saying 

that  4  -  optimal  design  maximizes  det  M  (\)  .  For  this  reason  .if)- 
o  o 

optimal  design  is  called  D-Optimal  design  because  it  maximizes  the 
DETERMINANT  of  the  information  matrix. 

Notation.  A  normalized  design  will  be  denoted  by  £  and  its  information 
matrix  by  M (t )  . 
o.i  Some  Basic  Results 

Linear  combination  of  two  normalized  designs.  Let  <4  and  be  two 
arbitrary  normalized  designs  given  on  the  closed  set"X_  •  Let  each  of 
these  designs  be  characterized  bv  the  corresponding  measure  '■.* )  and 

the  measure  \  (*)  .  Then  by  the  linear  combination  of  these  designs 

£  ='•.-<*)  6  t  V  , 

is  understood  the  normalized  design  with  measure 

V  '*)  =  C'.-ot)  \  '  'u  -V  *  \ ./  *  ) 

i  v  4  ^  \  A 

Relying  directly  on  the  definition  of  the  information  matrix,  it  is 
easy  to  verify  the  following  lemma. 

Lemma  1 .  The  information  matrix  of  the  normalized  design  £,  = 

is  given  by 

m(£)  =  (i-«0  x 


(12) 


(43) 


(44) 


It  is  known  from  the  theory  of  positive-definite  matrices  that 

If  A  and  B  are  positive-definite  matrices  of  order  m,  A  %  B,  and  oc  \ 


then 


(45) 


o(,  A  +  O-  “O  \ 


o( 

>  \  M 


\~  <*. 

\fc\ 


Using  (45)  it  is  trivial  to  verify  the  following  lemma. 

Lemma  2.  The  function  of  the  information  matrix  M  (£)  defined 

by  (44)  is  a  strictly  concave  function. 


That  is, 


(46) 


>  0-°0  lo<£.  1  \  +  °< 


+  <*. 
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Using  this  lemma  it  is  easy  to  prove  the  following  theorem. 

Theorem  1.  If  <£.  4  and  C,  are  two  normalized  designs  with  distinct  infor¬ 
mation  matrices  M  (<=.,)  and  M  ( ^ z']  ,  for  which  \ r^\C€- Vs) \  =  \^^{)\,  then  the 

design  d  +  >  o<=<<\ 

has  the  determinant  i  ^  C ^ ^  \  ^  \iN/\C.tl')\ 

Now  we  are  in  a  position  to  prove  the  following  important  theorem. 
Theorem  2.  (Uniqueness  of  D-Optimai  designs) 

Let  and  be  two  normalized  D-Optimal  designs  with  information 

matrices  M  ft,)  and  M  •  Then  =  'i(€j). 


Proof.  Suppose,  on  the  contrary,  that  M  C^i)  M  (£*')  . 

Construct  a  design  m  \  "T  v  ^  1  >  3  ^  *  ' 

Since  c,  and  s  i  are  D-Optimal, 

Hence,  by  Theorem  1,  MCO\  > 

This  contradicts  the  fact  that  £  is  D-Optimal.  Hence  the  theorem 
follows . 


Theorem  3.  (Diagonal  Information  Matrix) 

For  a  linear  response  surface  the  information  matrix  of  a  normalized 
D-Optimal  design  is  diagonal.  In  other  words,  the  D— Optimal  design  for 
a  linear  response  surface  is  orthogonal. 

Proof.  Let  £*  be  a  normalized  D-Optimal  design  with  information  matrix 

)  .  Suppose  M (£  )  is  not  diagonal.  Then  we  can  construct  another 

design  €.  from  £.*  by  taking  the  elements  of  €  the  mirror  image  with 

respect  to  zero  of  the  corresponding  elements  of  c*  •  Clearly  M  (,£-  )  ^ 

-y  y-  . 

M  C€.  It  is  not  difficult  to  show  that  \  C  =-\ )\  .  Now,  consider 

the  design  .  _  yz  ,  i  p. 

^  —  2.  -  z 

By  Theorem  1,  for  =  ’/ 2  > 

\  MCO\  >  1  )\  , 


which  contradicts  the  assumption  that  d*  is  D-Optimal.  This  contradiction 


proves  the  theorem. 


D— Optimal  Design  for  Quadratic  Response 


Kiefer  and  his  collaborators,  and  Pesotchiskv  have  considered  4>  - 
Optimal  designs  for  quadratic  regression  on  such  experimental  regions  as 


the  a,  -  simplex,  -  dimensional  ball,  -^-dimensional  cube,  etc.  t 


Decause 


these  regions  turn  out  to  be  much  more  tractable  computationally  and 
hence  many  results  can  be  obtained  algebraically.  For  the  reasons 
pointed  out  in  section  4  and  the  area  of  application  of  this  effort,  it 
will  be  desirable  for  us  to  consider  the  settings  in  which  the  design 
(controllable)  variables  are  restricted  to  the  n-dimensionai  cube 

X  =  Cn» Un . *1  •  -m ;  •  ■  *i’.  M  i 

Much  of  our  discussion  is  phrased  in  terms  of  certain  simple  subsets  of 
,  which  ve  now  define. 

baryeenter  o f  dep th  i_.  A  barvcenter  of  depth  i  (o  tii  r\)  is  a  point 

with  i  coordinates  equal  to  0  and  the  remaining  coordinates  equal  to  *1. 

/y\\  y'-i  T 

.-.e  denote  the  set  of  (  j  2  barycenters  of  deptn  i  by  <jL ,  and 

Y1 

write  <J  -  hJ  -J  i  .  Thus,  <J0  consists  of  the  vertices  of  C.^,  .J^ 
consists  of  midpoints  of  edges,  J2  consists  of  the  centers  of  2-dimen¬ 


sional  cubical  faces,  Jn  is  the  single  center  point,  etc.  For  example. 


for  C? 


C2  =  \  X  '  >  *  i  ''  ‘  ‘  *0  *  *  ^  ,  we  have 

Jo  =  |  (1,1),  (-1,1),  (1,-D,  (-1,-1)  \ 

h  =  J (1,0),  (-1,0),  (0,1),  (0,-1) ^ 

J2  =  '[(0,0)\ 

I  =  U  Jt  =  \  (1,1),  (-1,1),  (i,-i), 

1  -o  l 


(-1,  -1),  (1,0),  (-1,0),  (0,1), 

(0,-1),  (0,0)\ 


for  C  - 


(x^ ,  :<2 ,  :  1  x^\  £  1.  i  =  1,  2,  1>  ,  we  have 


=  ^(1,  1,  1),  (-1,  1,  1),  (1,  -1, 


1),  (1,  1,  -1) 


(CM)  (  1  >  ') 


Co,-\) 


(-1,  -1,  l),  (-1,  1,  -l),  (l,  -1,  -l),  (-1,  -l,  -1) 


0,-0 
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and  by  Farrell,  Kiefer,  and  Walbran  (1965,  [5])which  allow  the  choice 
of  design  (controllable)  variables  from  a  simple  subset  of  J  and 
establish  the  existence  of  a  symmetric  4>- Optimum  design.  For  the  proofs 

t3 

of  these  two  theorems  the  reader  is  referred  to  references  [3],  [4],  [5]. 
Theorem  4.  Every  D-Optimal  design  is  supported  by  a  subset  of  J. 

Theorem  5.  There  is  a  D-Optimal  design  that  is  symmetric  under  all  per¬ 
mutations  of  coordinates  and  multiplication  of  any  x^_  by  -1. 

In  the  light  of  theorems  2,  4,  and  5  we  shall  limit  our  considerations 
°nlv  to  Symmetric  D-Optimal  Designs  on  J_.  Further  characterizations  of 
symmetric  designs  are  contained  in  the  following  two  theorems. 

Theorem  6.  Any  symmetric  design  can  be  described  in  terms  of  a  probabil- 

vj  _  (  n  Yi  ...ri''7 

ity  (n+1)  -  vector  ~  \  c.  ’  1 1  ’  ’  ' n  ;  that  assigns  measure 

Tl.  J(  ?  j  2  to  each  point  of  J 

Theorem  7.  For  a  symmetric  D-Optimal  design,  there  exists  the  simplest 

•  ,  "jo  T"1  ^ 

probability  vector  J.  for  which  only  three  I.  O  are  positive. 

In  the  light  of  Theorem  7,  one  needs  to  consider  D-Optimal  designs 
of  the  following  form  only: 
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(  i)  Observations  with  weights  o<  at  each  of  2  vertices  of  the 


n-diraensional  cube  C  . 

n 

in-\ 

(  ii)  Observations  with  weights  at  each  of  ^  2  mid  points  of 
the  edges  of  Cn,  and 

,  ,  v'-'b 

(iii)  Observations  with  weights  7  at  each  of  ^ (Y'h  2  centers  of 
the  two-dimensional  faces  of  Cn, 

where  —  \  .  The  total  number  of  points  in  such  an 

experimental  design  will  be 


«n  iv\-\  ,  -n* 

2  +  ri  2  *  m  (rs-\  \  7 


=  2 


u-  -n  -v-  r\  '  r.-0\ 
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--  *  2"  +  |i  iT  V-»>-  +  -f  U"'* 

rhe  determinant  of  the  matrix  M(£  )  in  (47)  is  equal  to 

,  i  n  y>  Ctv-\)/2  r>-\  2) 

(51)  \\v\(t)\  ^  U.  v  (u-v)  \^u  4  (n-\)v  _  n  u.  \ 

as  shown  below.  Writing 

(52)  M(€  )  =  f  A  0  1 


where 


(53)  A  = 


0  B 


1  u—  n 


ul^  G  J  ,  and 


(54)  3  = 


uIn  0 


0  rx(W 


I  5vKC-)\  -  \6  \  \  §\ 

\  B\  -  Wl*\\v/I(*)\ 


Y\  C Tk- V  )/2 


-  U  V 


and  the  determinant  of  the  (n+1)  x  (n+1)  matrix  A  is 


1*1  = 


Lh-'*) 


1 

u 

u 

• 

• 

• 

a 

u  1  1 

u 

u 

• 

.  u 

u 

u 

u 

V 

V 

o 

> 

u-v 

0 

. 

0 

-(u-v) 

u 

V 

u 

V 

V  _  0 

0 

u-v 

• 

0 

-  (u-v) 

u 

V 

V 

u 

v  0 

0 

0 

. 

.  u-v 

-(u-v) 

u 

V 

V 

V 

u  |  u 

V 

V 

• 

.  V 

u 

1 

u 

u 

u 

u 

0 

1 

0 

0 

-1 

0 

0 

1 

0 

-1 

0 

0 

0 

. 

• 

. 

1 

-1 

u 

V 

V 

• 

• 

• 

V 

u 

=  lu- v) 


\  0 


o  t 


O  O 


V  V 


o  -i 


\  -l 


V  u. 


10  z  l  O  ...  o  -1 

;  +  a  o  i  •  ••  o 


o  0 


I  -l 


-(.U-v)  [  u  -t-  (r\-i)  V  +  t-O10  u2 

=  Cu'v)  [  U  -v  (t\-v)  V  -  2  UZ  ^ 

Substituting  from  (57)  and  (58)  into  (55)  we  get  (51) . 

The  determinant  \M(olwill  attain  its  maximum  value  for  those  values 
of  u  and  v  in  (51)  which  satisfy  the  system  of  equations 


JL  |MCO\  so 

“a* 


i.  1  r^(e)\  =  o 

and  "c)vy  1 


or  2u2  +  2.0-1)  uv  -  +  +  (m  +  l)  w  V  -  (^-')  v  _  O 

and  u2  +  ( r\-2)  uv  -  via  -  (^  +  0v2  +  O+D  u  v  =  O 


Solving  these  equations  under  the  conditions  >o ,  o/  -y>o  »  we  obtain 


(60)  W.  = 


0  1 _ _  i  2  Y\2  Jr  ?,Y1  t7  +  (Y\-l)  (4Y\1Jrilr\Jr\7)/M 

<4  (n*\)  <  L 


(61)  v  -  - - - 

•2  (mO(nur 


***  _  l  4v  TV5,  -v-  %  Jr  \\Y\  -  S  +(7ni-Prl-v5>)/ilttv\1  +  \2r,vl7)  j 


The  variance-covariance  matrix  (27)  for  a  quadratic  response  surface  for 
a  D-Optimal  design  with  information  matrix  given  in  (47)  becomes 


1  A 

r  Un 


V  \  b')  =  cr2,  m\ic)  =  ^  -n 


crz  F 


1  ~1  T 

r  u  In  2 


1  -\  T 

cr  v  I 


where 


=.  [_  U2  +  (lo-l)  uv  -  O-v)  V1  ]  T 


a  rv-\ 

s  (-\)  uT 


u  =  \_  U.  -V-  (  r\-l)v  _  (>-\)  uz  T 
0  m  (u2-v)T 
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and 


F  = 


A 

A 

A 

A 

u 

V 

V 

...  v 

A 

A 

A 

A 

V 

u 

V 

v 

A 

\y 

<> 

A 

V 

A 

VJL 

Y\  X  Y\ 


The  orthogonality  property  for  quadratic  response  surface  designs,  as 
given  bv  Eq.  (28),  requires 

<r  (  u  -  v  )  T  =  O 

which  leads  to  the  orthogonality  condition 


(63) 


U 


-  V 


because  T  ^O^T+C.  But  the  orthogonality  condition  (63)  does  not 
hold  for  u  and  v  given  by  Eqs.  (60)  and  (61)  respectively,  as  can  easily 
be  verified.  Thus  we  have  proved  the  following  important  theorem. 
Theorem  8.  D-Optimal  designs  for  quadratic  response  are  not  orthogonal. 


7.  RECOMMENDATIONS  FOR  FURTHER  STUDY  AND  INVESTIGATIONS 

As  already  noted  before,  the  validity  of  the  results  of  the  optimiza¬ 
tion  and  sensitivity  analysis  depends  heavily  on  the  accuracy  of  the 
surface  fit  approximation  procedure.  Even  for  a  given  experimental 
design,  various  estimation  procedures  for  the  unknown  model  coefficients 
can  play  an  important  role  in  improving  the  over  all  accuracy  of  the 
response  surface  approximation  and  the  entire  methodology. 

The  regression  analysis  currently  in  use  for  estimating  the  regression 
coefficients  in  the  polynomial  approximation  of  a  response  surface  using 
any  experimental  design  is  what  is  called  least  squares  estimation.  But 
if  the  design  is  not  orthogonal,  as  is  the  case  with  D-Optimal  designs 
for  quadratic  response,  the  least  squares  estimates  are  sensitive  to  a 
number  of  "errors."  Sometimes  the  results  of  these  errors  are  critical 
and  the  least  squares  estimates  even  do  not  make  sense  when  put  into  the 
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context  of  the  physics  and  engineering  of  the  process  which  is  generating 
the  data. 

,  / 

Estimation  based  on  the  matrix  yX  X _t'  H.  I  ]  t  K^C^rather  than  on  XX  , 
has  been  found  to  be  a  procedure  that  can  be  used  to  help  circumvent  many 
of  the  difficulties  associated  with  the  usual  least  squares  estimates. 

In  particular,  the  procedure  can  be  used  to  portray  the  sensitivity  of 
the  estimates  to  the  particular  set  of  data  being  used,  and  it  can  be 
used  to  obtain  a  point  estimate  with  a  smaller  mean  square  error. 

A.  E.  Hoerl  first  suggested  in  1962  (see  reference  [6])  that  to  control 
the  inflation  and  general  instability  associated  with  the  least  squares 
estimates,  one  can  use 

*  {  /  V-'  / 

^  --(XX  ui)  X  Y 

in  place  of  Eq.  (13).  Estimation  and  analysis  built  around  (64)  has  been 
labeled  "ridge  regression." 

In  the  light  of  Theorem  8,  which  establishes  the  non-orthogonality 
of  D-Optimal  designs  for  quadratic  response,  it  is  strongly  suggested 
that  a  few  case-studies  be  undertaken  to  verify  the  possible  superiority 
of  ridge  regression  analysis  for  D-Optimal  designs  for  quadratic 
response . 

Also,  other  optimality  criteria  should  be  examined  for  experimental 
designs  which  may  lead  to  orthogonal  designs,  if  possible,  for  quadratic 
response. 
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